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Heredity  of  Stationary  and  Reversible  Stochastic  Processes 

by 

Richard  F.  Serfozo 
Georgia  Institute  of  Technology 

Abstract.  When  a  stochastic  process  (a  random  measure,  set,  field, 
etc.  on  a  group)  is  stationary,  ergodic,  or  reversible,  then  certain 
functions  of  this  process  inherit  these  properties.  We  present 
sufficient  conditions  for  this  inheritance. 

Introduction.  Associated  with  a  queueing  network  process  (see 
Chapters  2,3  of  Kelly  (1979)),  there  are  a  number  of  stochastic  processes 
that  describe  various  aspects  of  the  queues.  Examples  are  (i)  the  point 
process  of  times  at  which  customers  move  from  a  certain  set  of  queues  to 
another  set,  and  (ii)  the  process  depicting  the  service  station  with  the 
largest  queue  and  the  length  of  that  queue  over  time.  When  the  queueing 
network  process  is  stationary  or  reversible,  do  these  associated 
processes  inherit  these  properties?  I  shall  present  general  criteria  for 
this  inheritance.  The  basic  issue  is:  If  a  stochastic  process  is 
stationary  or  reversible,  then  what  types  of  functions  of  it  are  also 
stationary  or  reversible? 

Preliminaries.  Let  X  =  (X(t):  t  c  R)  be  a  stochastic  process  with 
state  space  S.  Here  R  denotes  the  real  line  or,  more  generally,  a  group 
with  a  o-field  R  on  it  that  renders  the  group  operation  (addition) 
measurable.  Assume  that  X  has  sample  paths  in  a  subspace  X  of  the  space 
F(R,S)  of  all  measurable  functions  from  R  to  S.  The  process  X  is 
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stationary  if,  for  any  s  ,...,sn  in  R, 

X(Sj  +  t),...,X(sn  +  t)  -  X(s1),...,X(sn),  teR, 

(here  =  means  equality  in  distribution).  A  compact  way  of  expressing 
this  is  X  o  T  =  X,  t  e  R,  where  o  denotes  the  convolution  operator  and 
T  is  the  time-shift  transformation  on  R  (Tts  =  s  +  t).  A  stationary 
process  X  is  ergodlc  if  each  of  its  invariant  events  has  probability  zero 
or  one  (an  event  A  is  invariant  for  X  if  there  is  a  B  e  X  such  that 
{X  o  T  e  A}  *  B,  t  e  R) .  The  process  X  is  reversible  if  it  is 
stationary  and  X  o  T  =  X,  where  T  is  the  time-reversal  transformation 
on  R  (T  t  *  -t).  Note  that  X  is  reversible  if  and  only  if  X  o  T  o  T 
X,  teR  (this  is  sometimes  used  as  the  definition). 

The  preceding  terminology  also  applies  to  point  processes  and  other 
random  elements.  Let  N  -  (N(B):  B  e  R)  be  a  point  process  on  R,  where 
N(B)  represents  the  number  of  points  (possibly  infinite)  in  the  set  B. 
Stationarity,  ergodicity,  and  reversibility  of  N  are  defined  as  above, 
where  Tfc  and  T  are  the  time-shift  and  time-reversal  transformations  on  R 
(instead  of  R) :  TtB  =  B  +  t,  T  B  =  -B.  For  instance,  N  is  reversible  if 
it  is  stationary  (N  o  T  =  N,  t  e  R)  and  N  o  T  =  N.  There  are  similar 
definitions  of  stationarity,  ergodicity,  and  reversibility  for  random 
measures,  random  sets,  etc.,  and  vectors  of  these  elements. 

It  is  well  known  that  if  the  process  X  is  stationary  and  g:  S  +  S' 
and  h:  X  F(R,S')  are  measurable  functions,  then  the  processes  Y(t)  = 
g(X(t))  and  Z(t)  =  h(X  o  T  )  are  also  stationary.  (The  g  is  a  special 
case  of  h.)  Moreover,  Y  and  Z  are  ergodic  when  X  is.  See  for  instance 


! 


n  a 


Chapter  6  of  Breiman  (1968).  In  addition,  an  easy  check  shows  that  Y  and 
Z  are  reversible  when  X  is.  I  shall  now  show  how  these  results  extend  to 
a  larger  class  of  functions  and  to  point  processes  and  other  random 
elements . 

Results.  A  key  observation  is  that  stationarity  and  reversibility 
are  special  cases  of  the  following  notion  of  invariance  of  a  process 
under  a  family  of  "time"  transformations.  Let  Y  be  a  random  element  and 
let  4  be  a  family  of  measurable  transformations  from  the  domain  of  Y  onto 
itself.  The  domain  of  Y  is  R  or  R  or  cartesion  products  of  them.  The 
random  element  Y  is  invariant  under  the  set  of  transformations  $  if  Yoi|> 

Y  for  each  $  e  For  example,  the  vector  Y  *  (X,N)  is  reversible  if  it 

is  invariant  under  the  transformations  {T  ,Tt:  t  e  R},  where  T  and  T 
are  the  time-reversal  and  time-shift  transformations  on  R  x  R. 

For  the  following  results,  let  Y  and  Z  denote  random  elements 
(possibly  vectors  of  processes,  measures,  sets,  etc.)  with  sample  paths 
or  realizations  in  the  respective  spaces  y  and  Z.  Assume  that  Z  =  f(Y) , 
where  f:  V  *  Z  is  a  measurable  function. 

Lemma.  If  Y  is  invariant  under  the  set  of  transformations  $,  and  f 
satisfies  f(y)  o  <j>  -  f(y  o  $) ,  for  each  $  e  $,  y  e  V ,  then  Z  is  invariant 
under  the  set  of  transformations  4>. 

Proof.  This  follows  since,  for  each  $  e  $, 

Z  o  <(>  =  f ( Y)  o  $  -  f(Y  o  <j>)  =  f(y)  -  Z. 

Proposition.  If  Y  is  stationary  and  f  satisfies 
(1)  f(y)  o  T  -  f(y  o  Tf)  ,  for  each  t  c  R,  y  e  y  , 

then  Z  is  stationary.  If  Y  is  reversible  and  f  satisfies  (1)  and 
f(y)  o  T  -  f(y  o  T  ) ,  y  £  y,  then  Z  is  reversible.  If  Y  is  stationary 


HO. 


and  ergodic  and  f  satisfies  (1),  then  Z  is  stationary  and  ergodic. 
Proof .  The  first  two  assertions  are  special  cases  of  the  preceding 


lemma.  The  third  assertion  follows  since  {Z  o  T  e  A} 


B-l, 


{Y  o  T  e  f  (A) }  implies  that  the  invariant  events  of  Z  are  the  same  as 


those  for  Y. 


Example.  Suppose  Y  =  {(Y,(t),...,Y  (t)):  t  e  R}  is  a  queueing  network 

1  m 


process,  where  Y^(t)  denotes  the  number  of  customers  at  queue  j  at  time 


t.  Assume  that  Y  cannot  have  an  infinite  number  of  transitions  in  a 
finite  time  interval.  Specifics  on  the  operation  of  the  queues  are  not 


needed  for  this  discussion.  Let  Y..(t)  =  £  Y.(t),  the  number  of 

J  jeJ  J 


customers  in  the  set  of  queues  J  c  {l,...,m}.  Let  N  denote  the  point 
process  of  times  at  which  customers  move  from  J  to  another  set  of  queues 
K,  and  let  X(t)  denote  the  largest  number  of  customers  in  J  since  the 


last  time  the  number  was  zero.  Clearly  (N,X)  =*  f(Y)  «  (f^  (Y),  f2(Y)), 


where 


f,  (y)  =  I  I(Y_(t)  =  Y ,( t-)  -  1,  Y„(t)  =  Yjt-)  +  1), 


teB 


I  is  the  indicator  function,  and 


f2(y)(0  =  max  {y^  ( s )  :  <  s  <t},  t  eR, 


and  it  =  sup  (s  <  t:  y^(s)  =0},  assuming  that  exists  for  each  t.  Thi 
the  preceding  proposition  establishes  that  the  vector  (N,X)  is 
stationary,  ergodic  or  reversible  when  Y  has  these  respective 
properties . 


Extensions •  The  lemma  extends  to  state-space  transformations  as  well 


as  time  transformations  as  follows.  Define  the  random  element  Y  to  be 
(h,$)-invariant  if  h(Y  o  <J>)  =  h(Y)  o  <pt  <p  e  $,  where  h:  V F(R,S')  is 
measurable.  For  example,  if  the  process  X  is  ( h , {T^ :  t  e  R})-invariant , 
where  h(x)(t)  «  g(x(t))  and  g:  S  -*■  S  satisfies  g(g(s))  =  s,  then  X  is 
dynamically  reversible  (see  p.  31  of  Kelly  (1979)).  The  lemma  for 
(h,$)-invar lance  is:  If  Y  is  (h, $)-invariant  and  f  satisfies  h(  f ( y)  o  <j>) 
=  h(f(y  o  <p) )  ,  4>  e  $,  y  e  V,  then  Z  =»  f(Y)  is  also  (h,  <&)-invariant.  The 
preceding  results  readily  extend  to  time  and  space  transformations  h,<t 
that  are  random. 
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